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An instructional development project 
University of Kansas focused upon' two ma jor "cb'jective 
develop teacliing strategies to intpoduce" engtin^ering 
faculty to literature searching on comftuterized data 
to .help students develop effective on-flRne search str 
faculty workshop and an undergraduate engineering cou 
teach students methods of retrieving relevant literat 
for, reaching the objectives. Atti^irude questionnaires 
evaluations indicateia that student attitudes toward o 
search, methods^^ as well as quan*tity of relevant liter 
improved Vith the instruction and subsequent use cf o 
methods. (CHV) 
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Computer sj^ience has made rapid progress sinpe its technological 
inception in the 19^0* s. .Improvements^ 'in the reliability- of compo- • 
nents, more rapid internal operating speeds, and enormous amounts of 
accessible memory have all contributed, to present-day capabilities 
which would have staggered imaginations only 30' year^ ago. One regult 
of this progress has be^n ej5)anded computer service to the engineer- 
ing community, in both educational and applied environments. Problem- 
solving, simulation studies, computer-based education an(i computerT^ 
.ized information bases are generally representative of the services 
which have become increasingly important to e^igineers in recent years. 

The increasing iii?5ortance of computer applications*"in scientific 
and technological fields has gained national p2!*ominence. The Division 
of Science -Infongation 1(DSI) of the National Science Foundation is ' 
I currently sponsoring a number of projects with two basic goal's:^ 

4^ development of innovative tools to improve awareness 

by scientists, engineers and^ other users-of the avail- 
* , ' ability of soience and technircal information resources • 
.2) The imprpvement of cun;ently existing InstrucfeLonal 
materials for teaching effective use of information 
^ systems, by developing coii5)ut§r-assiste/instructi5iial' ^ 
, - ^ aids* ' > 

AH of the sponsored^pro^eptsVpe preciicated upon the 'iIl5)era- 
tpre need ^to base englne'erlng in(f sdientiflc work on a Iq^owledge of 
' •» * 

the Tiiost relevant and current state-of-the-art information. ' In ed- ' 

• ' • *^ ' ' ^ . ' ^ ' . 

ucatib^gJr-^t tings, the need for .increased awareness of scientific. 



and technical information resources centers on two problems; an in- 
crease in the amount of available information/ which approximates 
-an exponential curve in many fields,^ and the concomitant inability 
'Of librstries to provide extensive collections of books, journals • ' 

or docum,ents^ It is conceivable, and indeed probabjLe;,.that the 

: V ' . . . . ' ^ V 

future growth of infonnation bases will force many engineering ea- 

• * 

ucators and professionals to rely largely upon compiterlzed tech- 
niques to -retrieve the 'bibliographic sources they need* At the same 
time, there will be a need for educational programs at the under- 

^ V 

graduate and graduate levels which will provide training in the usa - 
of infon^tion resources. In a practical sense, two^^^cidents ex- 
amplify the need for more effective use of technical information. ' * 
First, the failure of the type of* suspension bridges built at^Tacoma 
Narrows, Washington was predicted years before, they were constnicted. 
Secondly, fire* hazards in certain types of kQO volt electrical equip- 
ment were documented In I960, though the design of somS equipj^ent in 
1968 failed to consider 'this problem publicly until 1^71. ... 

Three of the projects sponsored. by DSI/NSF directly Iffec^t^eh- 
g^neering education. The project at the University 'of- Califorpia^ 

at Santa Barbara is directed toward deveWping teaching ma,"&'ei*j|^lX, 

^ ^ ' 4 \ 

courses, and course sequences which will integrate the use-'of ;iH-.y 

^ *. * . 

'form^<)n resources into undergraduate science and englheering/H 

curricula. Another project 'at the New York Institute of'^^echnbl^^.'^'^ 

ogy, Westburg, Ndw York, is aimed at develop-ing^ study .and' trjinLng ^ 

materials for improving the knowledge of and access "lo teclmictfl 

ln^3^tioh by engineering stud^hts and faculty. The third pf^b'jpct^ 

■ ^ ' , . * ^ \ 

and the 6ubje4t of .this -paper, is being conducted at the University 

of Kansas and 'focuses upon the development of ^teacHlng. materials^ • j 



, to introduce^ engineering students and faculty to computer-assisted 
literature searching, wtiile stimulating mor^ effe'ctive manual 
search Methods* An' additional 'compone&t^of this project' is a follow 
up study to determine the extent; to which- graduates, employ t^se 
skills a-fter g/aduation. ' ' / \ - ^ ; ' 

The purposes of this: project were'; l) t^ dev-elop appropriate 
instructional delivery systems, including' m^^eriale and procedures, 
,2) to schedule and^ complete instructional sessioils in undergrad- 
uate and graduate engineering classes, and (^3) to assess the shott- 

( ; % / • ' ' ^ ' . ; 

and long-term effects of instructional intervention* The activ- 
ities which took place in these areas, during the first year of ^ 
•the project, wiii be described .in the following sections of this 
paper. v . .i ^ * 

>' I * ' 

Development of-^Instmctional Materials • 

During the summer of l976,'.piior to ^iiistructional intervention, 
the science librarian associated with '"the' project compiled infor- 
mation packets which focused on tools for searching th^ literature 
of electrical, chemical' and petroleum, and aerospace engineering-, . * 
.These packets focused 6n^ the use of indejcLng materials JLn each 
field, afid included a .glossary^ oT library and 4,nformat|.on vscience 
^terms useful'--ln literature searching* The packets w:^re used as 
the^primaW instruptional materials'"^dferin^'^the^first y^ar of the 



:t (1W77), 

general document entitled "Tools for Searching the Technical Lit- 



pfoject (1976-77), though they, have since be^n 2?fev:j.sed into a"-more 



eratiire"-* As a ^supplement to the information documents, a hand— 



out on search commands, codes, and data bases was prepared by two 
.engineering graduate assistants. This handout was aimed- at ac- 
•quanting students with the' steps necessary to prepare an on-line 
searcE using the Lockheed DIALOG^ system', the conq^uterized ifi^or- 
mation base employed by the project. - . * 

The engineering faculty. associated with the project collab- \ 
onated on the development of a sefies of 35nmi color slides ilrhich 
document and describe the information explosion and approaches to 
dealing with it. Slides were developed in sections which address- 
ed; 1) ^ Tke problem of information transfer and access, 2) the 
use of. the Engineering Index and other conventional and computer- 
ized literature sekrch methods in dealing with these problems, Snd 
3) search strategies* and san^Dle searches associated with^the use 
of DIAliOGl The slides -were originally used with the faculty work 
shop presentation duriij^ Fall 1976,, and subsequently revised for 

use in engineering classes in Spring L977* Bibliographies of 
* o 

* i ' * ' » 

thesauri, abstracts, indexe^^, and journal guides were also pre- 

pared, one for, each engine^;a*ing area dealt with, to assist with 

the instructional sequences dealing" with' manual searching. 

Instructional Procedures 

At the^inception Of thp project, instructional interventions 

were planned "to achieve two^ain objectives: 

1) to- communicate what c^-line searching is and why it 



-is -useful in the process of locating and acquiring 
needed information; 
2) to help students develop effective on-rline search * 
^ ^ strategies, • ' ' 

nAs the project developed in the first year, the second ob- 
jective was de-emphasized due to the substantial time and effort 
required for students to become proficient terminal operators in ^ 
on-line searching. In addition, it became apparent that the use 
of a trained intermediary to execute searches was both convenient 
and cost-effective. . * * 

The classroom presentations *dealing with on-lin^ searching 
employed the instructional materials developed, and took place in 
1 graduate and 6. undergrstduate- engineering classes during the- 1976 
77 academic year; Each session was accompanied. by a discussien 
period whei4 students were able to ask questions. Following these 
presentations, ,^'tudents (in small groups) were asked to prepare 
a* formal search strategy and make an' appointment for 'having the 
search executed. Students were also .expected to be, present during 
the actual search and to make any needed revisions In their strat- 
egies, based on the results they obtained* ' This latter coii?)onent 
of instmction, best described as experiential learning, -Was most 
successful with classes which had a scheduled lab period longer 
than 1-hourr • ' '/ . „ ' ' 

The in-class' presentations on manual lit era ture^ear^ching - 
• - ' * > * * , 

were almed^iat providing* students with -knowledge of ^ints. of 



access to tKe technical literatiire, as well as dpcument 'retrieval 

processes. Students were exposed to simulated searches,, beginning 

with the recognition of need for specific technical literature 

and culminating with the steps needed to obtain it. In identify- 

ing literature sources, anphasis was placed on jbhe efficient use 

of indexes -an,d' thesauri. Document retrieval trai^aing focused on 

acquainting students with the university libraries system and the 

use of inter-library loan in obtaining documents not o^ed by the ' 
* • • • » • 

university. 

A faculty workshop in coiiputer-aided preparation of bibliog- 
raphies was announc^ [ to School of Engineering faculty 
during the Fall 1976 semester. The workshop was conducted in two 
sessions; -the first session included presejitations similar to those 
made inJtengineering classes and^'the demonstration of an on-line 

. search by the trained intermediary. Faculty m^bers were then in- 
•Vited to prepare a search ^strategy on a topic of interest to them, 
for use at the next session which consisted of excuting searches 

-based'oi^ the strategies developed. The secpnd session involved 
each faculty memBer workiii^ith the integHOddiary for about an ^ 
hour of on-line searching'. - > ' . * — 

Instmct ional Vari ation 

It i6 necessaiy, at this point,. to describe -some differences^ . 
which aro§6 during instructional intervefition.^' Although all par- 
ticipating classes received identical presentations and the ben- r' 
efit of discussion periods, the same consistency did not obtain 



in the experiential . component of instruction^. This was largely . 
due to the fluctuations of .students' personal schedules and the 
topics assigned or suggested by. the instructors 'in engineering 
classes'. These differences become Important *iri the evaluation of 
instructional results, in as much^as it must be remembered that 
the observed results of training are the "average" results of^ some- 
what different instructional procedures -and, therefore, do not rep- 
resent the optimal condition where all participants would consis- 
tently receive both -training and hands-on experience in a closely 
controlled setting. It should, thus be kept in mind that the find- 
ings* of' the project would likely increase the situation where ideal 
condition? coul'd be implemented'. ' 
Evaluation Results , : , 

To siunmarize the aims of the project in its eafly phases, 
two main objectives were developed as follow: 

1) Engineering facu^y-^and students participating in 

the project ^will become persuaded^ that automated 
• . ' ^ 

literature* searching is an effective, tool in support 
of their work and will utilize it if it is available 
to them. ^ 

2) The^ quality and quantity of the information collected 
by engineering' students in the preparation of design 
and research projects will be improved .by the ujse of 
automated literature s^earching. • 

r 

The degree .to which the first objective was met was assessed by 
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jfnalyzlng the. results of seyeral questionnaires completed by faculty 
and students in participating ciasse.s and the faculty workshop. 
The second objective was tested through the int^'retation(of log 
data* which students gathere(i during automated and manual searches, 
. * Students who participated in Fall. 1976 classes completed a 
brief questionnaire which qsked them to subjectively rate Impor- * 
t^int instructional outcomes (see Table 1), Several conclusions '\ 
Kere determined by statistical tests of the obtained nesuJLts: . 

' - . 1) Students saw on-line searching as more efficient ^ 
' than manual -in terms of time spent. 

2) Students* saw on-line searching as more efficient 
^than manual in terms of relevant articles found. 

3) Students saw on-line training as more useful than i 



manual search ijraining. 

- — ■ — — : — 7v 

Insert TableXl about here 



coltel 



From these resi^lts, it may be- coiRluded that, students fouhd 

on-line searching tolfbe an effective tool in sttpf^ort of t'heir (Srork, 

thus .confirming that one objective 6f the project l;ad been met. j 

It is interesting to note that a majority of students preferred 

a combination of on-line and manual search techniquesj as opposed 

to, either method by itself. - ' . ' ' ^ . 

A iaore extensive questionnaire (the Literature Search Evaltia- 

♦ 

'tion, (Jf LSE) was given to Students in participating classes dur- 
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^ ing the Spring-1977' semester. .In addition, students in/several 
engineering classes which received training completed the ques- 
tionnaire and served as a compaWson (control) group in the evalua 
^ tioB of results. The differences in response between' training 
and control students may be seen, in detail, in Table 2. . The an- 
alysis of these differences showed that control Students who rated 
on-line searching unfavorably aX the beginning of the seme/ster 
tended to move toward neuti;al ratings a't the* end of the semester,, 
while s'tudents in classes moved f^om pi'e-semes^er neutrality to' 
• post semester favorability. In addition, ^^ralning students ex- • 
hibited significantly greater ^jonfidence tha^ controls in theil-- 
on-line and^ manual seajjch skills at the^end of thS .semester. . It 
may be concluded- that the st^Irfents wlio received training in the^ 
Spring semester, like those in the Fall semester, found on-line 
searching and general searching training to be an effect/Lve tool 
in support of their work. , . ' 



Insert Table 2 about here 



The data used to determine whether the second objective (im- 
pix)ved quality and quantity of informaifcion collected) was met is * 
presented in Table 3 . \ Relevant citations were tallied as those 
which' students rated ^as "good^' or "excellent". In comparing the 
on-line and manual search results on the same topic, it was found 
that students spent significantly less time formulating and con- 



II 



feting on-line searches and that the cost per rel.evtot citation-, 

¥ * 

'was lower for on-line searches. The resvilts from classes 'which 
cqiiducjted qnlyi anl)n-line search tended' to confirm these. - ^ 
ends. ^ The overall cost ^er- relevant ci tuition remained within 
a small, range ($1-6) for oxi-line , searches, with overall averages 
yQf $317oXindustrial estimate) ajid' $2/73'' (educational estimate). ' 
depending up^Jn the si'ze cf the data base search'ed,- these estimate^ 
'would seem to coi^titute^ominal costs per citation*. It may thus 
be concluded, for bo^ undergraduate and.j^duate^ students, ibhat' 
on-line searching- was effective in improving the 'quality and q^n- 



tity of citations proauced\it w^s\ also, cost-effective, forjDoth 



industrial andT educational settings 



^ \ Insert "lahXe 3 abcJnt here 




The FaIl-1^76 faculty 'workshop partkpipan^s lincluded 8 faculty 
'^members from civil, chemical and petroleiimyj|||^ depart-^ 
inq;ats, ras well as/2- members of the, library ^.taff . The majority of 
participants' indicated at the beginning of the first session that ^' 
they 'were; basically unfamilia^With on-lin^ search methods and re- 



suits. Participants rated each session, .at 'its completion, i3 three 
important areas; the results m^y be ^en in T^blo.^. j jfUx overall 



■'i^ating was also obtained subsequent to the second sessioii; with 

the results shown in Table. 5. The ^ purpose' of the faculty workshop' 
,was to /provide a general understanding 'o'f on-line* search techniques 



'^d their potential. Since trained intermediaries are, capable of 
' rprovidittg^sJiia-^ecli^ skills necessary' for oij7line searches, the' 
' ^ intent of the workshop .wa;^ to provide 'a conceptual understanding 
^d promoie attitudes reflective of acceptancerof ' tlte technique " 
^^.aiid'tru^t in the results. The evaluative assessments reveal that 
§1^ this pujcppse was .satisfactorily accomplished. <^ , ^ 



Insert Tables k & 3 about here 



Sxunmary * . ' . ^ 

The statistiqal anklysis of training, and search results in- * 
dicated tha,t the project had satisfactorily met the objectives of 
proiaoting more positive attitudes toward on-line searching, and im- 
proving the quality and quantity of citations yielded by this type 
of 'search* Student attitudes toward literature searching' in gen- 
eral were also improved by the instructional treatment* In addi- 
tion to^these objective findings, the anecdotal comments of par- 
ticipatiiig instructors were pooled and resulted in the following 
conclusions : 

- ' * 1) Instruction in literature searching enables engineer- 

ing students to locate and retrieve library materials with greater 
J 

efficiency and precision than was previously the casie* 

.2) Literature search activities performed by the studen, 

must be meaningfully related to the technical subject matter of t^e 

course, 'ratherHhah perceived as "busy work" « 

3) >The. use^f trained searchers ?is intermediaries between 

'the- engineer and on-line retrieval services ,will be cost effective 

for botK university and applied environments* 

\) Successful use of the instructional procedures. and 

developed materials^^depends' i?)on^a^genuine information need within 

the framework of the course , in^Vhl?* instmction takes plaqe* To 

A * - 

ensure this need and the students' ability to meet it, the specific; 
' topic must be carefully chosen and the literature checked in advance, 
at -least* in the early S9|a^qh efforts* 



Ik. 

It shotuLd be kept in mind that the positive results obtained in 
it 

this project are tied to a relatively brief instructional and 
practice sequence. There is good reagon to believe that even more 
positive effects would obtain in sfbua:tidns where a larger pro- 
portion of course time, or a one-credit ^ort cours#, could be^de- 
v6*tpd to search training, 

The present project encompasses two objectives which were not 
mentioned previously as they are presently untested,. The first 
of these is a study to determine to what extent engineering grad- 
'uates who receiv%d training maintain a positive attitude toward 
on-line searching and a tendency to use it whe^i appropriate and 
when prevailing conditions permit such use. This objective is cur- 
rently being assessed by a follow-up study .which asks engineers who 
received training as students to report the degree^ to which they 
encounter literature needs that require a search and\he avail- 

ability of on-ll^e searching in their current professional positions 

m 

The questionnaire will be accompanied by an offer to provide 
on-line searches at cost to engii^sers who do not have^glocal access 
to the tool, 'The second objective is to assesis the need fbr and 
availabllty of on-line searching to engineers who did, not receive 
formal training as students, TMs step will^ yield comparative in- 
formation for contrasts with engineers who were trained and will 
jserve to acquaint a larger group' of engineers with the potential ^ 
of on-line searching and the 'at-€0st availabllty of the technique 
if they should need it or wish^to become familiar with the method, 

is ' 



The educational and practical demands of the rapid growth of 
QOginB^rlng information bases have ^be en, and will continue to be,, 
amply ^illustrated. ' The overall goal of the present project is to 
eahance the qualitjr of engineering education by developing an in- 
structional ^equence and materials which may be used in existing 
courses to acquaint students with more- effective techniques of 
' literature searching. It Aay b6 concluded that this goal l;as thus 
^ far been met and, in conjijnction with the results of related pro- 
jects supported by NSF, it is likely that the on-going effects of 
literature-search ti^aining will make themselves felt as a higher 
degree of quality in engineering' practice • 




Refer ences 

1. Womaok, B.F-. , "Computers In Education: Tools for Today's Teach- 
Ing," Englneerlag ' Education . vol. 67, no. 7, April, 1977, pp.692-" ' 

2. Giiz, C, "The Education of Users of • Scientific and Technical 

Information, paper presented at the National. Federation of Abstract- 

ing and Indexing Services 'annu§l Conference, Columbus, OhiOj March) . 

1976. ,Reprln.ts are available from Educational Research in Cir- 

culat^ion (ERIC) as ED124-l68; IR003-558. 

* . *■ * 

3. Kriz, H.M^Ki' Citation Counting and the Future of .Engineering 
Libraries," Engineering Education , vol.67, no',7, April, 1977, pp.^. 
707-710. • \ ' . 

Roebling, J., l85§ quotation in " Wheels: Life Science Library ." 
Time, Inc., New York, 1976,. p. 128. ' ' . . . 

5. Anonymous, "The New York and Brooklyn Bridge," Scientific - American . 
vol.XLVII, no. 21;^ May, 1883, p. 325. ' 

6. Kaufm&n, R.H. , & Page, J.C. "Arcing Fault Protection for Law* 
Voltage Power Distribution Systems," IEEE Trans actions; Power 
'Apparatus and Systems , I960, p^.l60. ^ ' . ^ 

7. Rummer, D^I., P.E. , personal correspondence on a pending product 
liability suit.' ' . - ' • ' 

8. ^ National Electric Code - 1971,'- published by the National Fire^ 

** • * - 

Protection Association, section 230.95. * * * 

« 

17 



r 



Table 1 . 

o Student Responses to Items 'Concerning. Maiiuaii' *''* , " • ^ 

and pn-Line Literature Searches (MLS/OLS) during 'f;air,*^1976 



Item 



1. Qonducted an MLS? ' . 

• 2r 143^, efficient in time spent? 
3. MLS. efficient for # of ' articles? 



1. Conducte.d an AI^? 

2. A£S efficient- in time spent? ' 
B.^'^^fliS^efficient for #. ^f articles.? 




Students 



Grad. 



Undergrad 



YES NO 



YES NO 



5 

1 
■it 

5 
5 
5 



0 
it 
1 

0 
0 
0 



22 
9 
13 



21 
21 



20 



1 

lit * ' 
10 * 

1 

1 * 

2 * 



Student Ratings and Preference for OLS and MLS 



Item 



/ 



1. ^ Usefulness of library trai^iing? 

2. Usefulness of N(LS training? 
\ UiSefulness of MLS materials? 
,k. Accuracy of results - MLS . 

over ALSl? ' 

^1. ' Use?iilnes3 of ALS"^raining?^ 
2.. Usefulness of ALS materials? 



Preference for ICS^ ALS, or a 
combinations?, 



Search 
l^ype 



Both V 



Gtad 



Undergrad 



MEAN 



SI> MEAN 



1.8 
1.6 " 
2.2 ■ 
it. 2 



1.2 
2.6 



.1.3 

1-3. 
1.6 

1.3 



3.65* 
3.56 
3. '♦3 
3.62 



SD 



.it5 2. it 
1.3 2.7 



1.3 

1.5 *^ 

1.3 

1.6 



1.6 
1.3 



14LS ALS COMB 
■6 1' it\ 



MLS ALS" COMB 
. 1 7 13 



Note: All items,' exce^ as noted', are -scored on a Likprt scale from 1 (very 
- , uspful) ik> '6 (no Value-). 



1. Scored on a Likert scale from.l 



Wore accurate) through it (equal) 



•' to^7 (much less accurate). 

' 0 " 2. Da;ta are reported as frequencies-. , - ' 

* si'^ficant difference (£<.0l)^ between 'ALS and MLS, using MeNemarJ.sJigs t . ' 
' significant difference (p<.05) between classes! ' ^ 

O T** signiflcaitt dlffer^face (p<.05r'between-OLS and MLS and between classes 



) * 



Table 2 

f 0 •* 

Treatment vs. "Control Post-Test Differences 
. by Items on the Literature Sea^^ch Evaluation (LSE) Scale 

Level o,f 

Item S-ta t emen t 



4^ I 



'Si«nif: 


Item 




Median' 


SD ' 


ic 

% 


1 ■ 

■ 2 ♦ 


TR 
CO- 

TR 

GO. . 


i...46. 
1.69 

2.05 
2.80 


1. 39 ' 
' 1.75 

1.97 
2.62 


,55 
.55 

.82 
1.07 






-TR 
CO 


2.45 • 
2.93 


2.31 
2.75 


■.95- 
1.10 




4 


TR 
CO 


2.56 
3.36 


2.35 
3.29 


.98 
1.09 


* - 


5 ^ 


XR 
CO 


3.69 
3.'27 


3.74 

3.17. 


-.92 
.84 




6 . 

r ' ^ 


TR 
CO 


2.79 

3.80 


2.64 
3.87 


1.00 
1.03 




7 

* 


TR 
CO 


3.26 
3.97 


3.44- 
'4.10 


1.00 


+ 


8 


TR 
CO 


3.12 
3.93 


3:10 
4.05 


1^4 
.97 


+ 

a 


• 9 


.:TR 
CO 


2.56 
3.99 


2.31 
4.10 


.98 
.94 




10 


TR 
CO 


2.69 
3.19 


* 2.-63 
3.08 


.96 
.77 




11 


TR 

CO • 

» 


3 01 
2.81 


3.07 
2.88 


1.04 
.69 




12 


JR 
CO 


3.91 
3.24 


4.04 
3.14 


1.05 
.79 


'\ + 


13 


TR 
CO 


3.60 
3.03 


3.78 

3.02, 


ll02\ 
.•66 \ 


•+ 


14 


- TR 
CO 


2.55 
2.83 . 


2.45 
• 2.91 ■ 


1 


« 

+ 




TR 
CO 


3.69 
3.31 


•3.76 
3.19. 


.85 - 
.64 



literature ^earch skills necessary for 
engineers CTR = + agree) 

have sufficient knowledge^ for conducting 
^m^jttial search for design problem (TR* -fagree) 

sufficient skill for manual search (no 
difference) 

adequate instruction in manual search \ 
(TR = ^.agree) O 1 . ^ 

iianual preferred over auto t(CO^= + agree) 
adequate instruction in auto (TR = ^ agree) 
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as engineering student-acquirel4 sufficient 
skill in auto (TR = + agree) 

sufficient skill for auto search on design 
problem (TR = + agree) t 

I understand how to develop auto search 
(TR = + agree) 

satisfaction ^with overall results of auto 
(TR « + agree) 

axxto more expensive than manual (ClJ=^+ agree) 



manual over auto rdr tilie and effort 
(CO « + agree) , ' * ' ' 

manual over ajito' :^or relevant items' pYo^uced 
(CO » agree) ^ " ^ ^ 

auto summaries more comprehensiye than 
manual (TR « + agree) 

eq^i4ipment needs make auto impractical 
(CO « + agree) 











* 


• 4 * 




t 


1 \ 


• f 

. o / 




a 


\- ' 


at' * . 




> 

laOXe^Z ^COuC u. ^ >^ ° 




Level of 
SiKaif..' 


Altem 




X 


Median 


SD 


Item Statement 




- + 

t * ' 




; 16 . • 


TR 
CO 


'2.47 
2.87 


2.47 
2.93 


.70 

.41 vi^ 


> : ' 

auto options satisfactory (TR « + agreed 


' a * 






-17 

N 


M' 

CO 


3.57 
3.04 


3.72 
3.03 


.91 
.70 


manual preferred because individual is in 
control (CO » + agree) r 








18 


TR 
CO 


4.56 • 
3.88 


4.66 
3.99 


.60 
.93 


literature search of little valxie in' 
engineering (CO * + agree) 


1 








TR , 
CO 


3.22 
3.38 


3.18 
' 3.22 


.98 
•.75 


satisfied with auto service accessibility • 
(TR « + agree) . '^'^ . 




i 




■ 20 


TR 
CO 


2.87 
3.19 


• 2.81 
3.10 


.86 
.82 


satisfied with thesauri; etc. accessibility 
(TR = + agree) . 




NS 
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TR 
CO 


1.97 
2.05 


1.94 
^.05 


.77 
.72 


auto service and training ishould be pro- 
vided to engineering students (both agree) 


L 


NS 
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t 


TR 

CO ■ 


2.72 
2.70 


2.59 
2.70 


•99 , 

77 


most needs met throiigh' manual search 
vDOtn agrees 


■ \ 






Significance levels : . * » 


.05, + 












• 










t 


















y 








% 

t 




■r ' 








t 














' ■ " 1 
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- . ' . ' Tables" - . / * ^> . • ' ?• 
,.• ; / Cost/Relevance -Estimates for 1.976^77. ' , ' 


Item ^ 

\ 


■•• • f.,-*? 

Search 
Type 


- ^ . . • >-'.*• , Classes " ' ■ 


Averae© - v , 

classes 


PaU-76 ; 


' . . Sgring-77 • 


• .EEl»90 

• V" • . / 


CPE801I 


- ^ EE6i»l 

« 


CPE6'99^ 

« 


%522l 


1 time (hrsO 
. total 
citations 
' relevant , 
, • citations 
cit, 's redun- " 
dant \o ALS 


- MLS 

. V 


1.5 

5,28 k.Q 
1.1k' -.99 


80" 
15 .. 
. 15 . 


^.15 -.'i^:, . -. - - 
^ 9.26 k.'^ 

.8.65 h:2k- 

1.83 ■ 1.59 




'- 


7.I1 '.j 
9.97 / ■ 
9.96 
l.»»9 • 


cost per rel^ cij;, on 
^ a per-student basis 


. '■■ 


$12.55. $13.08 


t " 

$5^.33 


$3.'»6 $3.00 ' - 






$23.11 , 


time (preparatio'n) 
time {on--line) 
total 
"cit.'s 
- ' • ^eX. cit- ^8 . 


OLS 


'1.86 ' 1.1 
' .3h , • .16 

^♦6.3 23.5 
.20.5 9.5 


k-65. 

105 
- ^8 . 


^7 .5 V 1.02 .6 
• .37 .15 .35 .13 
: ' c 
28.1 9.9- 25.2 15.5 
,l't.9 5.5 10. i 7.2 
-T- 


1.19 .80^ 

176 \|*1 
k2 ikO 


.89 - 

.'52 
17' 


1.25 
.80 

-7,7. .7 
hl.'H 


cost I ^ 
.cost II 

cost per- 

rel- cit- 




$33.51 $li».i»3 
$27.6i» . $11.65 

■$3.^5 $2;01- 


|l86.li» 
$26'.i»q-*- 

$»».»»3 


)2i».98 $9.82 $2k.2k -$8.83 
532. 2i» $13.21 $35^62 $13.P7 

$3.^8 $2.8i» . $5.92 $3.67 


$105.77 $9't.65 
$30.9^ $20.80 

' $3.26 $.'^2 


$60.88 
$23. 1'* 


f7?.7^» 
^28.11 

$3.76' 


— — ■ — • ^-f* — j"^-" 

COlJt I 

cost II 
• cost per 

• « rel. cit- 

— ■ >■ • . ^ 


b 


$33.51 $li».i»3 
$13.3^ $6.10 

$2.88 $1.59 


5186. ii» 
$9:96 

$i».08. 


i 

1 


^2»t..98u $9.82 $2i».2i» " $^.83 
$»».05 $2.0,1 $8.22 $i».l6 

$2.35 $2,21 $3.11 $1.76 


$105.77 $9'».65 
. $7.1'* $'».80 

$2.69 $.71 


$60*88 
^5.3i» 

$3.90 


575. 7'J / 
$7.5'» / 

$2.73 /V 


. a - Industrial cost estimates; user time = $10/hr. ,4i intermediary time = $l6/hr. Manual searches- include u&er 
^ time only-. . .. . - , . ' 
'b - Eduqational cost estimates; intermediary time - $6/hr-, ,user time = 0 • , ' * / ' 
^ ^- - includes on-line, print^out, and telecommunication costs ♦ * ' * , . . / 
• . C - includes. user and intermediaiy time costs- 7 - - - ^ /I 
1 - search was conducted as a group' - no' individual searches * ♦ , • H . \ 

ERLC . 2i • ^ / . \ . . . ' 













Tafcle \ 






Ratings 

0- / 


of 1976 Faj^ulty Workshops- 






j ' ^ ^ Session I (Nov^ber 30) 

4 ' ^- I ^ 


■ 




^ Item / \ ' ' 


Scale ^Interpretation ^ 


MEM _ 


'SD' 


New. information acquired 


1 = Considerable 
6 = None 


1.67- 


1.12 


'utility to faculty or 
. 'professipnal needs • 


^ 1 = Very Useful 






• - jyOverall rating of session 


1 = Excellent 

5 = Boor ^ 


1.67 


.71 


Session 11"- (December 2) 


New information acquired 


1'=^ Con^der&bl% 
' 6 = None 


VM 


•79 


Utility,^ faculty or 
^ - professional needs 


r = Very Useful 
6 = Of No Value 


• 1.86' 


. 90 ^ r 


Overall rating of session 
. r . 1 


1 = Excellent 
5 = Poor 


1.57 


*.79 










y. ■ 






0 


• • 















J 
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Table 5 ' ■ 
Overall Ratings of 1976 Faculty Workshops 



Item > , ' 


" . / ^ 

Scale Intemretation 




SD 


* > •» " 
Utility of Infojmation acquired 

Utility of infomatioil for AIS 




1.29 


.16 / 






.79 


Utility for. adaptation to your 




2.2- 




courses 


1 = Very Useful 






Utilitjj^for- shading with your 


6 = Of No VaTue 




••79 


graduate students 


t 


Utility of AIS for the pi^c- 




l.lit' 




t icing engineer 







Two participants did not respond to these items. 
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